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ABSTRACT 

Integrated Learning Systems (ILS) can be used as 
instructional tools and to produce reports on student progress* TJiree 
different systems from Curriculum Computer corporation (CCC), Ideal 
Learning, Inc., and Jostens Learning corporation were piloted in 
three elementary school to evaluate ILS usefulness in 
reading/language arts and math. The pilot evaluation was to answer 
questions about II^ results in other school districts, implementation 
problems, day-to-day operations, instructional program and district 
goal correlations, staff and parent ratings, academic achievement 
improvements, and Chapter 1 instruction* Qualitative measures 
(classroom observations, implementation difficulties, and curriculum 
review) and quantitative measures (parent, principal, and staff 
surveys, pre-pre/post-skill test scores, and costs analysis) were 
used for evaluation. Test scores did not show major differences in 
achievement? however, teachers, parents, and principals stated that 
ILS had positive effects on children's learning. The IdecQ program 
had the most weaknesses such as implementation and curriculum 
problems? CXiC was more expensive but made more academic gains than 
Jostens. recommendations include continuing CCC and Jostens programs 
for another year and discontinuing the Ideal system. Standard 
deviations of test score comparisons and copies of surveys sent to 
parents and school staff are given. (8 references) (EJS) 
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EXECUTIVE SUMMARY 



The venders and schools involved in the Integrated Learning 
System (ILS) pilot project in the Wichita Public Schools f 
1989-1990 were: 

Conputer Curriculua Corporation (CCC) Harry Street 
Ideal Learning I Inc. (Ideal) Cessna 
Jostens Learning Corporation (Jostens) Adaas 

Literature: 

The literature supported ILS systeas. CCC and Jostens 
were both reported as products which would seet needs in the 
reading, language arts, and aathenatica areas. 

Lab Implementation; 

CCC - No major problems 

Ideal - Problems with Podium software; not enough 

curriculum in primary grades. 
Jostens - Some software management probl^^ms which were 

easily remedied. 

Qj^ yriculum : 

Reading - Jostens best for Heath; CCC for ITBS. 

Language Arts - CCC and Jostens both acceptable. 
Mathematics - CCC first choice; Jostens second choice. 
Chapter 1 - ILS not compatible with present 

objectives; CCC would be most compatible. 

Pftrtigjpftnt B^ftgt49ngi 

Principals - All supported ILS in general; their 

specific system in particular. 

Teachers - All supported CCC and Jostens; Few 

supported Ideal. 

Parents - Overwhelmingly supported all systems. 

Informal Meaaurenents: 

CCC had highest gains in reading f math; Jostens in 
writing. 

Stftndftrdiggd Tggting: 

CCC showed highest gains in reading, language, and math. 
Cost : 

CCC - $451 per pupil first year/$81 subsequent years 
Ideal - 283 47 
Jostens - 405 77 

Recommendations; 

1. Discontinue Ideal at Cessna. 

2. Continue with CCC and Jostens at Harry Street and Adams. 

3. Study further these systems for cost and configuration 
possibilities and use in Chapter 1. 

4. Plan to purchase CCC as first choice; plan for expansion 
to other schools if subsequent data so indicate. 
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INTRODUCTION 



Wichita Pilot 



In 1988 a district coaoittee coapoeed of adainiatratora and 
ieachera studied the uae of Integrated Learning Syateaa 
(ILS) as an inatructional tool. The ILS committee 
recommendation wae to pilot three By"*?;" JSJ* Ivi^-m 
in three elementary achoola for the 1989-1990 school ayetem. 

The vendors and achoola choaen were: 

Curriculum Computer Corporation (CCC) Harry Street 
Ideal Learning, Inc. iS™ 
Joatena Learning Corporation aaama 

Integrated Learning Syetema (ILS) can be defined as computer 
aystemB that provide inatruction in several J^^^ect areaa 
and include the production of reports P^^!f?f^ 

?Smith & Sclafani. 1989). I^^^^^^^^S^ ''^^^f .f" f^jr^ii'' 
individualized is distributed to a class of students via 
computer te?Slnal8 or through a network of microcomputers. 

The goal of ILS developers and users is that computers 
would*. 

- through software, provide masterful instruction, 
consistently and on demand; 

_ help organize and manage the individualization of 
instruction for millions of students; 

- boost educational results nationwide and worldwide across 
all curriculum areas for all students; 

_ t.n h« fri^gr.».t:an. create a new kind of jofjice 

SSsiSSle tha^ would create, market ^^JJJf ^J^S)^^"* 

of ILS systems by educators. (EPIE Institute, 1990). 

ffoT- -fche Wichita pilot, instruction was limited to 
reldlSg/^llSuage arts -and »ath ^.^i^^r^r" 
♦K^rtiiff>% ffrade five were scheduled for 20 minutes in 

read?M^ag^^^ a -e\-f J° -iS^^-^SeS^ 

twice a week. The CCC program ^-''i**^^^* ^^^f^^ Irts 
Pupils received ten minutes of reading/ language arts 
inatruction and ten minutes of math Instruction in one cUss 
period four times a week for gradea one through five. 
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Evaluation Desiffn 

The Wichita ILS pilot er.lu.tlon «.» designed to answer the 
following questions: 

1. What are the re.e.rch and evaluation reaults from other 
school districts? 

basis? 

3 . Are the instructional programs correlated with district 
objectives? 

4. Is ILS a possible avenue for Chapter 1 instruction? 

5. How do staff and parents rate the program? 

6 Is there evidence of academic achievement as a result of 
the ILS programs in general and with each specific system? 

To answer these questions, the following measurement 
Btrategies were developed: 

The Srojecf i?Sluator will visit each grade level in each 
sShoSl a? lealt once during the ^^r^^^f,?'*!^^,^.! 
SSrtnff the spring semester. The evaluator will note pupil 
S^Sa^or cJass^Som environment , implementation procedures . 
a^d visii informally with pupils, teacher, and lab 
attendant . 

?he ^aS^rtUSSiwuTe^p a log -^ic^ ^puter 
do™ti-e, ;-ic, calls; 



hardware 
teachers 
teachers 



evaluator will BUBB.rize this infornatlon. 
a' 5Se'=uri?SuluB coordinators tor ,le»ent.r, "'dinf • 
objectives for their curricular areas. 

systems for compensatory instruction. 
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1 . Surveys : 

Surveys filll be developed and sent to all teachers, 
administrators, and lab attendants at the end of the project 
year. A random selection of parents will be surveyed. 

2. Heath Reading Placement Test: (grades 1-5) 

The math inventory score will be utilized as a pre and post 
measurement to determine growth. Pretesting will occur 
between September 25 and October 13. Posttesting will occur 
between April 30 and Hay 18. 

3. Harcourt Math Inventory: (grade 1-5) 

The math inventory score will be utilized as a pre and post 
measurement to determine growth. Pretesting will occur 
between September 25 and October 13. Posttesting will occur 
between April 30 and Hay 18. 

4. Language Arts Assessment: (grades K-*5) 

The USD 259 Language Arts Assessment for grades K, 1-2, and 
3-5 will be utilized as a pre and post measurement to 
determine growth. The first assessment will occur by 
October 13. The final assessment will occur during the 
fourth period by Hay 18. 

5. Iowa Test of Basic Skills: (grades K-5) 

a. The ITBS reading, language, and math scores for each 
grade level from the spring 1990, administration will be 
compared with the spring 1989, scores in each school. 

b. The ITBS reading, language, and math scores for each 
grade level from the spring 1990, administration will \yi 
compared with the scores of a comparable school. Factors 
used in identifying comparison schools were socio-economic 
status, similarity of programs, previous ITBS data, and size 
of school. 

The comparison schools will be: 

Adams Sunny s ide 

Cessna Funs ton 

Harry Street — Franklin 

Hote: In calculating the statistical data, only scores for 
children who have been in a project school all year will be 
considered. 

6. Cost analysis: 

A cost analysis for future implementation will be provided 
for each program. The analysis will include but not be 
limited to cost of hardware, software, consumal: les , lab 
setup and maintenance, and personnel. 
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School Differences 

One of the problems associated with the evaluation of the 
ILS progran «as controlling for factors, other than the 
prograa Itself, nhlch may have Influenced learning. In the 
ILS situation the three schools had very different 
demographic characteristics nhich may have caused 
differences in test scores and other measurements. 
Demographic characteristics for each site are listed belon. 



INTEGRATED LSABMIN6 SYSTEMS 
SCHOOL DEMOGRAPHICS 

CCC Ideal Jostens 
Harry Street Cfisfina AdABO — 

Percent Free 

& Reduced Lunch 51% 34X 39% 

3-90 

Percent Minority 

Population 17% 265/ 47% 

3-90 

Average Dally 

Percent Present 94% 90% 95% 

89-90 

Mobility 

Percent of Change 32% 16% 20% 

89-90 

Avercige Clas^^ 

Size 20 2'5 26 

9-89 

Total School 

Population 285 412 310 

9-89 



Vendor Descriptions 

Each of the ILS products have some similar characteristics 
and some aspects which are specific to the vendor. 
Descriptions of each of the systems were prepared by Betty 
Roeser of Instructional Computer Services. 
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General Description: 

An Integrated Learning Syetem (ILS) Includes a wide range of 
courseware with a sophisticated management systea that can 
be tailored to district objectives. These systens use 
computers to diagnose, reinforce* and enhance learning. The 
systems monitor student achievement and provide 
documentation (reports) on student improvement. 

Software : 

Computer Currie»1»ni Coryorationi CCC offers curriculum in 

the areas of mathematics and science, reading, language 
skills, basic competency, and computer education. The 
system can give student, course, grouping, and gains 
reports. At the beginning of the year the students may take 
an Initial Placement Test to determine the level they need 
to start. The computer program keeps track of each 
keystroke the student makes; it evaluates, diagnoses and 
places the student in the next lesson. The teacher may 
choose to have the paraprofessional change the assigned 
lesson but most generally the computer places the student. 
It is a closed system because "the system" evaluates and 
diagnoses the progress and places the student on a dally 
basis . 

Ideal Learning. Inc.: Ideal offers curriculum in the areas 
of language arts, reading, math science, foreign language, 
and basic skills. The system offers a filtering function 
that allows teachers and administrators to set criteria for 
selecting and grouping of students for any special 
requirements. An example may be to select all students 
between 10 and 12, who are in the sixth grade and scored 
below 70 on Onlt 1 of sixth grade math. The teacher must 
prepare the student lesson plans and give them to the 
paraprofessional one week prior to the students going to the 
lab. The computer does not diagnose, prescribe and place 
the student. This is an open system because "the teacher" 
gives input daily. 

JoBtpna Learn tnp Corpora-fcioni Jostens offers CUrriculUK In 

the areas of reading, mathematics, language arts, and 
science. The system can give student and class reports. It 
is a closed system because "the system" evaluates and 
diagnoses the progress and places the student on a dally 
basis. At the beginning of the year the student goes 
through the Basic Skills Inventory. This Is used to place 
the student. The teacher may choose to have the 
paraprofessional place the student at a certain level or 
lesson but this does not have to happen. 



Hardware 

Crfmr^iii^mT niirriffulun CnrporatiQa;. 

Hardware roquiremente at Harry Street for 1989-90 
Server: Mlcrohoat. 40 Mbyte disk, 3 graphic eervere, 

central etation, printer ^ 
Workstation : 24 Atari 1040 with color, 1.25 Mbyte 

memory, mouse, and headsets 
Hardware Choices Available: Atari, IBM. Tandy 

Trf*%jtl CQrpfty<*tlon. Inc.: 

Hardware requirements at Cessna for 1989-90 
Server: Macintosh SE/30 with 2 Mbyte memory. 40 Mbyte 
disk, printer 

Workstation: 24 Apple lie with color, 128K memory, and 
headsets 

Hardware Choices Available: Apple 

Jnatiftng W ming Corporation.!. 

Hardware requirements at Adams for 1889-90 ^ 
Server: Macintosh SE/30 with 2 Mbyte memory, 40 Mbyte 

disk. CD ROM drive, printer 
Workstation: 24 Apple Ilgs with color, 1.25 Mbyte 

memory, mouse, and headsets 
Hardware Choices Available: Apple, IBM, Tandy 



Literature Review 

To date there is no body of independently conducted 
longitudinal, quantitative research on the effectiveness of 
ILS systems. Most of the research and evaluation of ILS 
programs has been vendor supported. These evaluations show 
glowing results with children making academic gains. One 
needs to consider these results with caution because of the 
built in bias. 

One independent study was conducted in the New York City 
Public Schools (Swan, Guerrero, Mitrani & Schoener, 1989) 
during the 1987-1988 school year. Thirteen vendors placed 
computers in 26 different schools at all levels. Results 
showed that computer instruction did make a difference in 
academic achievement, decreasing as the grade level 
increased. The program was most effective with the 
elementary special education students, least effective with 
high school regular education students. 

The most comprehensive review to date was sponsored by the 
National School Boards Association and prepared by the 
Educational Products Information Exchange Institute (EPIE). 
EPIE is a consumer supported, not-for-profit organization 
chartered by the Regents of the State University of New 
York. 
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The evaluative study conducted by EPIK (1990) was 
qualitative In nature looking at eight vendor produote. 
Courseware waa evaluated for reading, language arte, and 
aatheniaticB for grades K-8. Twenty- four urban, suburban, 
and rural school sites were visited for each of the systens 
studied. Students were observed using the ILSs, and 
interviews were conducted with teachers, students, 
administrators, and ILS lab managers at each site. 

The study concluded: HO ONE IIS (i.e. ILS) STANDS OITP ABOVE 
THE OTHERS IN ALL DIMENSIONS. For each dimension, the top 
rated systems were chosen. These are listed in alpha order 
with only the vendors used in the Wichita pilot noted. 



Price: Ideal 



Management System: 

R^mm nf naa Ideal 

T) \ manamt tr » /Pirmmcrint. 1 Vft Cflpab i 1 i tV CCC 
T<>n-h4nff fwrtw-rt^iignogtie^ None 

Srhftriu^tTig Options Jostens ^ i 

RftPortB No clear leader - Ideal allows customization 
Hnrd P^^^Anning Jostens , 
ry^Ar-A Pi*r<:v fiftft.w>ir#> Availabilitv Ideal 
rnnt.fimigintf T.^tnnonn * Sp«n4«i r.ftWBon Asstgnmentfi 

Jostens (automatic schedule mode only) 
r)n-Hn<» toola CCC (not available in all courses) 
Q-fcher Jostens - Alternative Pathways for 
remediation of specific skills 



Courseware : 

Runga of nurrigulft Covuraga CCC 
pvarull Co "rn«w<irii Quality CCC Jostens 
Tmaginati viitnftna anH Crflattvftnaaa of Teaching Jostens 
Q-fchar Jostens on-line network version of Compton's 
Multimedia Encyclopedia on a CD-BOM disc. 

In addition specific curriculum areas were evaluated and the 
systems most worthy of consideration were listed (alpha 
order) . 



Pejtriintf 

Word Identification Skills 
CCC 

Jostens 

Comprehension Skills 
CCC 

Jostens 

Whole Story Beading 
CCC 

Jostens 



T»nngnflgft Arts 
Writing as a Process 
CCC 

Jostens 

Discrete Language Arts Skills 
None 



Writing as related to Beading 
Jostens (grades 5-8 only) 
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Wathamatlcfl 

Computational Skills 
CCC 

Jostens 

Understanding and Applying Concepts 
CCC 

Jostens 

Other conclusions from the EPIE study worthy of note were: 

- Current market products are simply extensions of computer 
aided instruction and have not as yet reached the level of 
learner-adaptiveness needed. 

- Host schools could be making more effective use of ILS 
through better staff training and better integration of the 
ILS into the larger curriculum and instructional life of the 
school. 

- A wise choice of lab manager and adequate support by 
administrators can make a difference in implementation. 

- There are many "hidden" on-going costs which vendors fail 
to stress. 

- ILSs are perceived positively by students, teachers, and 
administrators . 

- School staff state ILSs are beneficial to students in 
regard to motivating students, individualizing instruction, 
and increasing time on task. 



EVALUATION RESULTS: QUALITATIVE MEASURES 

Classroom Observations 

The project evaluator visited each grade level at each of 
the three schools twice during the school year. Anecdotal 
data are reviewed below. 

CCC Harry Street 

- Students were most always busy with computers. A 
learning atmosphere was evident at most times. 

- All lessons were individualized for students after 
placement based on computer testing. 

- Some students worked through lessons faster than others . 
If there was not time for another complete lesson, 
computer was shut down and these students then lined up. 
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Slower students were distracted and did not want to 
conpletd lesson. 

- Children le^irned percentage of correct answers after each 
lesson. 

- Children had to sign in name and number. Mas ditx'icult 
for yourger children. 

- There did nut appear to be too many problems with 
hardware. They did exist, however, as with any technical 
system . 

- Reports were extensive and were utilized by staff. 

- The children wore headphones which, besides reinforcing 
with audio, seemed to keep them on task. 

Jostens Adams 

- All lessons were individualized based on testing by 
computer . 

- Students were most always busy with computers. A 
learning atmosphere was evident. 

- There seemed to be lots of minor bugs in system. These 
were rectified almost immediately by lab attendant and 
usually did not cause too much loss of time. 

- The system operated on a strict timetable. There was no 
time flexibility. However this did allow students to 
work up to last minute. If there was not time to 
complete a lesson, the computer would automatically put 
in a filler. 

- There were too many children in class for computers. 
Those who did not have a station sat at tables and read 
books or colored. Regular classroom instructional time 
was loat for these students when they later made up 
computer time. 

- Teachers were able to use a "T-plug" i.e. putting in a 
lesson for entire class which reinforced classroom 
Instruction. When this lesson was finished, system would 
revert to individualized lessons. 

- The lab attendant developed many visuals and used special 
helps based on vendor suggestions. 

- Reports were easily understood and were utilized by 
teachers on a regular basis. 



13 

9 

I 



- The progr.« utilized headphone. J^""*"" °" 
t«k Ld reinforced information through hearing . 

Ideal Cessna 

- Pro«r«» had no orientation eea.ion. nor placement ^^^^^^ 
teeUng. the t«;-=her decided i.^eon to all 

TfVrT^r fi e j 
began using sons Individualization. 

- M."VtMrhSd=sssrti^^^^^^ 

times . 

_ The lab attendant had to res^t computers after each 
lesson* 

behavior and time on task was limited. 

- At upper levels, the math problems required paper and 
pencil for computations, 

4. ^AA^A to -the system until late in the 

- ;::r°;S:y'':«e"SSt'«:d ll tl^ot the eoft»are. 

Personnel 

The need for a qualified lab aide was evident in all 

The neea i^or « hm^ classroom teacher to be in the 

e'hl^ced"^ ?ea?r"ted b, the abilities and endeavors of 
both the lab aide and the teacher. 

Lab iDplementation 

Direct compariaona of program tSree'taS** 
?^'inconaiatent recordi^^^^^^ 

:^tre» trouiSSu;t"tSe%e.r C^^^^^^^^ 

Zlo^l'llTt^li^ l^rTlVJ'^T. Ule-a later in the 
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Reports from Harry Street (CCC) were limited to September 
and October. The reports suggested that after a few minor 
technical adjustments * the system ran very smoothly. It 
should be noted that the project eyaluator observed minor 
disruptions at other times. 

Initial reports from Cessna (Ideal) indicated 
dissatisfaction with vendor service in getting the progreuB 
up and running. Initial commands and processes needed 
clarification. Later problems were noted particularly at 
the kindergarten and first grade level. The management 
reporting system for K-2 was not useful to teachers. 
Several math and language arts lesson created problems and 
were updated the beginning of second semester. No problems 
were recorded after this time. 

Numerous problems were reported at Adams (Jostens), most of 
which were solved by rebooting. Actual down time was most 
often attributed to electrical problems and power boxes. A 
major system error was reported in January, the system was 
updated and no other major system errors were reported. 
While the Jostens system appeared to have more problems 
recorded, the vendor technical support seemed to be 
sufficient to maintain a functional operational system. 



Coordinator Input 

The curriculum coordinators in reading, language arts, and 
mathematics were asked for input regarding the three 
systems. They were specifically asked for information as to 
correlation with district objectives, strengths and 
weaknesses of the three systems in relation to their 
specific curricular area, and the benefits for students. 
Responses from the coordinators are summarized below. 

Reading 

Both the Jostens and CCC programs contained adequate 
diagnostic, prescriptive and reporting systems. Jostens 
more directly complemented the elements of the Heath reading 
program. CCC more directly complemented the elements of 
the ITBS reading subtest. For purposes of raising 
standardized test scores and for promoting computer 
literacy, the CCC system contained a broader scope of 
program material for each grade level . 

Language Arts 

There was no direct correlation with language arts 
objectives by any of the systems. None of the programs 
utilized student's written products which are needed to 
address language arts needs. Ideal was unattractive to 
students as the language lessons were simply written 

15 
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sentences trlth options for answers, listed on a blank 
screen. 

All students could benefit from XLS systems. Gifted 
students will benefit the least from canned programs which 
involve only acceleration not enrichment. Children needing 
remediation will benefit from the drill. Regular education 
students will benefit from programs which include a variety 
of instructional methods. 

Mathematics 

CCC was the program which best met the mathematics needs of 
students. The program had great depth and scope, strong 
curriculum materials at all grade levels, and could 
administer to the wide range of student abilities. Other 
strengths of the program included comprehensive reports, 
diagnostic capabilities, and a superior tutorial program. 

Jostens was next best in meeting the mathematics needs of 
Wichita students. The system had excellent graphics, 
prescriptive abilities, and good reports on student 
achievement. 



Cha£.ter 1 Input 

In many urban districts, ILS systeua are already playing a 
role in compensatory instruction. Some school districts 
utilize the systems as a supplement, others are utilizing 
the systems with limited additional teacher intervention. 
Results of the various models have yet to be analyzed. 

The EFIE report stated: 

although the up- front cost of an ILS may appear 
high, when amortized over a period of five years, 
the anticipated result should prove to be quite 
cost-effective. If the cost ia added to the 
regular Chapter I personnel costs, most programs 
will not be able to afford ILSs. If funds become 
available by means of attrition, however, the 
combined services of an ILS and Chapter 1 teacher 
should prove both beneficial and cost-effective. 

The Director of Chapter 1 for Wichita stated that current 
philosophies in reading and math compensatory instruction do 
not directly correlate with an ILS system. Reading is 
committed to preteaching utilizing the Heath language based 
approach. Hath is committed to the use of manipulatives and 
motivational activities. The Director stated that the CCC 
system matched the priority objectives of Chapter 1 more 
closely than the other systems. 

)6 
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BVALOATIOH RESOLTS: QOAHTITATIYB BBA80RBS 

Sarvay Results 

Surv.,. were -ent to .11 f-'t^SjltSnir^?^^^^^^ , 

below. 
Principals 

Each principal w.B-upportive of I^f .^^.'-'^JinSpat'" 

district - 
Teachers 

4. TK-» *t4n« teachers (70%) who responded to 
aS;;;; SH"Sp orISS SiriL^o'S: Effective for »o-t of 
thei? pupllB and Santed to see the lab "n*in>»?J.i» 

Si-i Th« m.lorltv of teaehora stated that the CCC 
Ito^l. „I^%"HMve "or hUher ability children and 
most effective in mathematics. 

Eight of the nine responding teachers ^eP^f**^^^^^ 

utilised mostly for "^^J^f^^^^rt^terc^SSeSt^ f?om teachers 
ina-hruetional or remedial, wrlixen coHiHie«»»'B 

record keeping By»te» for aaae^.aing student progress. 

Seven of these ten stated «as ef iectlve 

their -tjf S'tSrSSSoo?" ^e -ajority of 

^Se":.s:r;itit^d]?s:i? ir,j^iii^'d':i^:JxL^:''ii. of 

?-Se?r^e;ff?:r;Se1r:S^.» was utilised 
mostly for reinforcement. 



(100%) 



all wanted the program continued in the school. 
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The majority of teachers reported that Jostens was not 
equally effective for all ability levels but there was no 
consensus as to which group it was most effective. The 
majority of teachers reported that Jostens was equally 
effective in reading, language arts, and reading instruction 
and that Jostens was utilized mostly for reinforcement of 
instruction. 

In written comments the teachers stated students were 
excited about learning and the program improved students' 
self -concept. 

Parents 

A total of 282 parents (35%) responded to the survey. 
Parents from all of the three schools were extremely 
supportive of the ILS programs. 

Over 90% of parents indicated with positive responses that 
the program helped their child in both reading and math, 
that their child liked going to the computer lab, and that 
the program should be continued and expanded to other 
schools. The only positive response under 90% was from 
Cessna where 86% of responding parents reported their child 
being helped in reading by the ILS experience. 

The written comments from each of the schools were again 
mostly positive. Some examples were: 

CCC; 

I believe that computer lab has helped alot not 
only in learning but also in his interest in the 
school period. I would hope to see computer lab 
remain in schools & then some. School boards 
should not only be concerned of their learning 
ability but as well whether or not if their [sic] 
interested. Which can keep them coming back & 
accomplish more. Thank you for being concerned & 
helpful. 

Ideal; 

I feel that all children should have experience on 
computers. I was very glad that my child could go 
to computer lab and I think every school should 
have this program. 

J.Qatena..; 

I have four kids at Adams and they all love the 
ILS computer iab. The lab has helped my K,l,2,3 
grade kids. I think it is the beat thing for the 
school. 
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Inforsal Heasurenents 

Pr« and poettesting uslns infonaaX measureaents were 
conducted at each II*S site. Pretesting occurred in the fall 
of 1989; posttestintf occurred in the spring of 1990. 
Average gains nere conputed for each grade level at each 
school. 

Reading 

Teachers were asked to place their students on a reading 
level using the Heath reading series guidelines. The 
placenent level involved both a silent reading test and 
teacher judgement. These placenents were then converted to 
a nuserical value for computing gain scores. The numerical 
value does not indicate grade equivalent, but rather a level 
gain More gain was expected at lower grade levels than at 
upper grade levels. 



Average Reading Level (»ains 



Grade 


CCC 

Harrv Street 


Ideal 
Cessna 


Joetens 
Adsns 


1 


2.73 


1.93 


1.80 


2 


1.59 


2.02 


1.31 


3 


1.12 


.95 


.87 


4 


1.06 


.75 


.06 


5 


1.42 


1.20 


.28 



Language Arts 

The locally developed USD 259 Language Arts Assessment was 
utilized for determining growth. Teachers were asked to 
mark students after the first nine weeks and again after the 
fourth nine weeks. The rating choices were: l^superior 
progress; 2=satiBfactory progress; 3= improvement needed. 
For purposes of this evaluation only gains from the writing 
assessme t sample were computed. 



Average Writing Assessment Gains 



CCC Ideal Jostens 

Grade Harrv street Cftfians Adanrr 

1 .53 .28 .47 

2 .09 .45 .46 

3 .23 .43 .48 

4 .25 .07 .45 

5 .33 .16 .09 



Er|c 15 r 



Mathematics 

X. A 4.^ in later the math inventory froB 
problems increased. 



Average Hath Gains 



CCC 



Ideal 
Gftflana 



Jostens 
,Ada&fl — 



1 
2 
3 
4 
5 



6.20 
5.95 
6.62 
12.20 
18.42 



4.00 
5.58 
8.16 
10.94 
11.11 



6.30 
2.42 
4.12 
11.12 
8.35 



* frrr\ showed greater gains in reading at four 
Harry Street (CCC) J'^^vr-e grade levels. Adams 

^rai:e orair.:»:2s^"p- ^^^^^^ - 

schools . 

Standardized Testing 
The Io»a Tests of BaBic Skills (ITBS, -^'e^'^^S^^r^'th^ee 

!I»9'?2S!;?2 iTleA't^ scKools. 
1990/1989 Comparisons 

These =nrthnr:'na:1r::rteeer!S'^h^^^^^^ 
neceesarily the ««»e students nor *he, st^ ^ ^^^^.^ 
llllt^ nllaSf :Siiviier«.ini 1.0 should be realised. 
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GRADE 1 

Average Grade Equivalent Gains 



Word Analysis 
Vocabulary 
Math 



cxx; 
Harry Strfiai 

1.5 
2.0 

1.7 



tdaal 



1.0 
1.1 
0.7 



Jostons 
0.5 

1.1 

0.8 



GRADE 2 

Average Grade Equivaient Gains 



OX 

Hamr Strftflt 

Vocabulary 1.3 
Reading 1.2 
Math Q.a 



Ideal 



1.3 
1.3 
1.3 



Jostens 

1.3 
0.9 
0.8 



GRADE 3 

Average Grade Equivalent Gains 



Vocabulary 
Reading 
Math 



OX 
Harry Sfr«^ft| 

1.2 
1.0 
0.9 



Ideal 



0.1 
0.4 

0.2 



Jostens 
Adarps 

0.9 

0.8 

0.5 



GRADE 4 

Average Grade Equivalent Gains 



OX 
Harry !jtf«*»t 
Vocabulary o.9 
Reading 1.2 
Language 1.3 
Math 1.2 



Ideal 



0.8 

0.7 
1.4 
1.1 



Jostens 

0.9 
0.7 
0.5 
1.0 



GRADE 5 

Average Grade Equivalent Gains 



OX 

Vocabulary 1.9 
Reading 1.3 
Language 2.3 
Math 2.2 



Ideal 



0.7 
0.9 
0.7 
0.8 



Jostens 

Adams 

0.5 
0.1 
0.4 
0.7 
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The 1990/1989 data showed consistently sreater gains than 
the expected 1.0 at Harry Street. Cessna sains were mixed 
with very low gains for grade 3. Adams showed consistent 
gains of less than the expected 1.0. 

Comparable School Comparisons 

m««« Stmimarv Tiata Tables I. II, and III show each of the 
ILS school average grade equivalent compared with their 
control school grade equivalents. The average grade 
equivalent (GE) represented the entire regular education 
classroom at testing time, not Just those who had been in 
the program all year. 

Harry Street (CCC) had consistently higher GSs than the 
control school Franklin. Cessna (Ideal) had lower 6Es than 
the control school Funston in over 2/3 of the measurements. 
Adams (Jostens) had lower 6Es than the control school 
Sunnyside in over 2/3 of the measurements. 



TABLE I 



CCC 

Av*rag« arad* EqulvaUnt 1990 





WA 


VOC 


RD6 


LANG 


MATH 


KSNOERSAfiTEN 












Harry Strwtt 


K.8 


K.7 






K.8 


Franklin 


K.7 


IC4 






K.5 














GRADE 1 












Harry Strt»t 


2.4 


2.1 


2.0 




2.2 


Franklin 


2.2 


1.6 


16 




1.9 














BRACE 2 












Harry strati 




3.0 


2.8 




2.8 


FranitHn 




2.6 


2.7 




3.2 














GRADE 3 












Harry Stroat 




3.8 


3.9 


41 


39 


Franklin 




39 


39 


40 


3.7 














GRADE 4 












Harry sirtai 




4.9 


5.0 


5.5 


49 


Franklin 




47 


47 


5.1 


46 














GRADE 5 












Harry Streat 




6.7 


6.5 


7.2 


70 


Franklin 




5.4 


5.5 


6.0 


54 



2i 
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TABtS n 

IDEAL 



Avtrmg* Qrad* Equlvmltnt 1990 





WA 


voc 


ROO 


LANG 


MATH 


KINOEBQAFrrEN 












CMtM 


12 


IC4 






K.9 


funton 


12 


K.6 






1.0 














QRADE 1 












Cmsm 


Z1 


1.B 


1.6 




2.0 




1.9 


1.9 


1.7 




1.8 














GRADES 












Canna 




ZB 






32 


Funttwi 




3.0 


^9 




3.0 














ORA0E3 












C«8sna 




3.8 


3.7 


4.1 


3.7 


Fufttton 




3.8 


3.6 


42 


3.8 














OFtA0E4 












Cessna 




4.7 


4.5 


4.9 


4.8 


Furuton 




5.4 


5.4 


5.7 


52 














GRADES 












Cassna 




5.5 


S.9 


6.1 


5.7 


Funaton 




6.1 


6.0 


6.3 


6.1 



TABLE III 
J0STEN3 



Avtraga Qrada Equlvalant 1990 





WA 


VOC 


RDQ 


LANG 


MATH 


KiNDEFKSAHTEN 












Adams 


12 


K.8 








Sunnysida 


K.S 


K.9 






K.8 














GRADE 1 












Adams 


1.6 


1.6 


1.9 




1.7 


Sunnyskia 




ZO 


1.9 




i1 














GRADES 












Adams 




3.4 


2.8 




3.0 


Sunnysida 




3.1 


3.1 




2.9 














GRADES 












Adams 




3.3 


33 


3.4 


3.3 


Sunnysida 




4.6 


4.5 


4.9 


4.1 














GRADE 4 












Adams 




4.9 


4.6 


4.7 


4.8 


Sunnystde 




5.0 


5.0 


5.5 


5.1 












GRADES 










Adams 




5.5 5.2 


5.7 


S.5 


Sunnysida 




6.2 1 6.3 


6.3 


6.3 



ERJC ,^2-3 



Bn w ft^"^*^ Tables IV, V. and VI depict raw score ITBS 

data for only those students who had been in the ILS schools 
and the control schools all year. An independent t test was 
performed at the .05 confidence level- for each subject area 
for each grade level. 

There were 54 separate t tests calculated. Results were: 

14 statistically significant for ILS 

29 no statistically significant differences 

11 statistically significant for control schools 

In general all ILS schools showed more of the significant 

differences in the prinary grades- Harry Street had the 

highest number of significant differences of all the ILS 
schools . 



TABLE IV 



ccc 

Hurry StrMt • Franklin 
Maan Raw Scoraa 





WA 


V 


R 


L 


M 


(N) KDG 












(2$) Harry 


25.0 


20.8* 






26.1* 


(37) Frinkiin 


23.2 


18.8 






23.0 




P-.280 


P-.01S 






P-.006 


m GRADE 1 












(55) Hwry 


3S.4 


16.8* 


37.1* 




21.2* 


(38) FranHUn 


33.0 


12.4 


30.4 




17.5 




p^2S2 


P-.001 


P-.002 




p«.000 


(N) QRADE2 












(35) Hany 




15.7 


41.3 




21.2 


(44) Ffwrddin 




13.8 


39.4 




24.0* 








P-.482 




p».021 


(N) GRADE 3 












(48) Hany 




18.2 


27.9 


21.5' 


26.5* 


(37) Franklin 




17.S 


26.0 


17.8 


23.4 






P-.547 


P-.367 


p«.003 


p«.018 


(N) GRADE 4 












(44) Hany 




21.1 


30.6 


23.1 


28.0 


(46) Franklin 




21.3 


29.7 


23.1 


26.0 






p«.673 


p>.629 


p«.987 


p».l23 



• StstlstieBfly SIgnifiesnl '.05 i 

• H.rrv 8tf t * Frmfciifl 

Kdg Voe, Mlh Orad* 2 Mth 

Gra(te 1 Voe. Rig, Mth 

Gndm 3 Ung, Mth 



ERIC 



24 

20 



TABLE V 



IDEAL 
Ctstna - Funtton 
Maan Raw Scorat 





WA 


V 


R 


L 


M 


(N) KOO 












(64) Cmwu 


27.0 


tS.8 






25.7 


(74) F\am»n 


26.2 


2o.r 






28.3 




p>.439 


P-.007 






P-.489 


m GRADE 1 












(54) CM«na 


33.8 


13.2 


32.4 




19.9* 


{6S) FuflStofl 


32.6 


1S.1 


33.8 




17.6 






p>.073 


p«.490 




P-.005 


(N) GRADE 2 












(63) Cassna 




14.3 


40.0 




23.5- 


(69) Funston 




15.7 


41.9 




20.2 






p»t96 


P-.328 




p«.000 


(N) GRADES 












(50) Cassna 




17.6 


2S.3 


18.9 


23.8 


(67) Funsion 




18.3 


25.9 


20.4 


23.3 






P-.468 


f>-.738 


P-.242 


P-.716 


(N) GRADE 4 












(ST) Cessna 




21.1 


28.0 


21.7 


28.4 


($6) Funston 




25 0* 


34.2- 


2S.S' 


28 7 






P-.001 


p«.D01 


p».003 


P-.06D 



* SUtitttcftlly Signlfletnl .05 i iMt 

*£jiujui * Fyntign 

Grad« 1 Mlh Kdg Voe 

Qratft 2 Mth Grid* 4 Voc, Mg, 

Mlh 



TABLE VI 



JOSTENS 
Adams - Sunnyside 
Mean Raw Scores 





WA 


V 


R 


i L 


M 


(N) KDG 












(38) Adams 


27.9* 


2i.r 






27.r 


(37) Sunnysida 


249 


19.0 






23.4 




P-.01S 


P-.010 






p«.000 


(N) GRADE 1 












(41) Adams 


29.7 


14.6 


35.2 




17.2 


(36) Sunnysida 


34.8* 


15.0 


34.8 




20. r 




P-.005 


P..7B9 


P-.791 




P-.013 


(N) GRADE 2 












(54) Adama 


22.6 


18.1* 


39.6 




22.0' 


(44) SunnySKia 


21.7 


15.4 


41.5 




19.4 




P-.421 


P-.042 


p«.448 




P-.014 


(N) GRADES 












(47) Adams 




15.3 


221 


15.7 


19.6 


(41) SunnySH^a 




21.7' 


30.6* 


23.6- 


25.4* 






p— .OOC 


p-.0(K) 


p-.OOO 


p-.OOO 


(N) GRADE 4 












(39) Adama 




21.0 


27.0 


21.9 


27.3 


(36) Sunnysida 




21.9 


30.7 


24.0 


27.6 






P-.548 


P«.t03 


p*.230 


P-.854 



Kdg WA, Voc, Mth Crad« 1 WA. Mth 

Grada 2 Voc« Mlh Crtd* 3 Voe. Rdg» 

Mth 
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Cost 



K.=h vendor wae aeked to P"l"%SSi^i?Sry"*ir:«iSS J"o 
their product in one 30 station l*ooraxory ix c y 

?s:^:s:j".ie'2?L:n;rr, .^"iSSnt of 350. 

Vendor Cost 



Hardware 

*(MicrohOBt) 

Software 

Manuals 

Support/ 

Maintenance 
Installation 

Inservice 
by Vendor 



Total 
Per Pupil 



$69,578 

50.050 
300 

12,655 
7,076 

1,500 



$141,158 
403 



$47,966 

29,000 
NC 

750 
NC 

1,500 



$79,216 
226 



$55,036 

54,600 
NC 

11 ,650 
NC 

900 



$122,186 
349 



Additional District Cost 
ccc Ideal 



Wiring 
Telephone 
Tables 
Salary /Para 
Teacher Training 



$ 2,500 
650 
NC 

12,000 
1,600 



$ 2,500 
650 
2,974 
12,000 
1,600 



$ 2,500 
650 
2,974 
12,000 
1,600 



Total 
Per Pupil 



16,750 
48 



19.724 
66 



19,724 
56 



Grand Total 
Per rupil 



$157,908 
451 



$96,940 
283 



$141,910 
405 



*CCC advertised that the nicrohost can serve several 

*ccc aaver^iBca ^^^^ would e cut. 

cost would be lowered. 
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To sustain the program in schools J^J-^iJlSf ' ""^^ 

following dollars would be needed. (Does not mcAuae 

inflation) . 

CCC $28,405 81 per pupil 

Ideal 16.500 47 per pupt. 

Jostens 26,800 77 per pupil 



FINDINGS 
Discussion 



literature supported iliS as a *. ^^i. t>ilot to 

instruction and there was some evidence in this Piiot xo 

support this contention. 

TV,- ■hA«-h score data did not show major differences in 
ISSi:"L:r« f «eult of ILS after one , ear of t.-Un« 

children cannot be ignored. 

All three of the systems piloted had f'^^^. 
weaknesses. The Ideal program at Cessna had the most 
weakSesses. There were 

curriculum problems or lack of curriculum ^5°^ ' ^.^^^^^ . 
Teachers were given the responsibility ^^^^^^^^^n^^*"^^ 
they did not want this responsibility. 0^1^ ^S""*" 

behavior and time on task in the other labe. 

The CCC and Jo.tene program. »?°:"'';L"iSurand''''* 
curriculum «-b »f *° en.Sr^g S^ien^tvSn^S oS the 

"t^'xllll "'The ieaeonS Sere aS^oiStically individualized. 
EeporCr»errBU«iSieSt'':Sd utilized by teachers. Teachers 
liked the programs and wanted them to continue. 

What were the d"*-"-"^^" *''"c^r«a,"?£e"ore°«p;nBl?: 
of hardware and test scores CCC *he^» 

program. 1".!"}"°" *° ""iSfi^ it Incompatible with other 
ITslTdt :Sft«re.'"5o:?e"s"^msed Apple hardware which 

could run other educational software. 

Students in the CCC P'°«"»/^ri«;SILr?e»Mng**iSe^teSt 
on informal measurements and standardized testing. me xes-o 

score differences, however, must be considered in view of 



o 
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several factors. First the pilot was conducted for only one 
year. To obtain an accurate picture of academic 
achievement, a longitudinal study must be conducted. How 
accurate a picture was presented by the measurement data for 
this one year is unknown. 

Second, the schools themselves had very different 
demographics even though both had large numbers of at-risk 
students. The CCC site had a very low socio-economic 
population. The Jostens site had a very high minority 
population. The class size at Adams (Jostens) was much 
higher than Harry Street (CCC) . Both third grades at Adams 
had a total of four substitute teachers per classroom 
beginning in February until the end of the year. 

The Harry Street demographics have remained stable over the 
past years whereas Adams demographics have changed rapidly 
in the last two years. Separating the effects of program 
quality and demographic characteristics were not possible in 
this study. 



Conclus ions 

ILS pro 1 act . There appeared to be sufficient qualitative 
evidence in both the literature and this pilot to justify 
continuing with the ILS project. 

ana Adamg ■ There were no major problems with lab 
implementation. The curriculum coordinators were all 
satisfied with the program. The Chapter 1 director stated 
this system was most compatible with Chapter 1 objectives. 
The principal, staff, and parents liked the program. 
Students always appeared attentive and interested. 
Achievement gains were documented by both informal 
measurements and standardized testing. 

Trieal Ceaana . There were numerous problems with lab 
implementation. None of the curriculum coordinators 
recognized the program as acceptable. Parents and the 
principal were supportive; staff were not supportive . 
Students were often inattentive. There were no discernable 
gains with either the informal measurements or the 
standardized testing. 

Joa-fcena AHama . There were a few problems with lab 
iisplementation but nothing major. The program was 
acceptable with the curriculum coordinators, although rated 
second choice by the math coordinator. Jostens was 
determined to be the most compatible with the Heath reading 
series by the reading coordinator. The principal, staff, 
and parents liked the program. Students always appeared 
attentive and learning. The test scores were disappointing 
for what appeared to be a quality program. On the informal 
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of all the qualitative data and survey results. 

ThA difference in >est score data was evident w^-^i^ ^CC 

!^^'*:"^??L«^c^?ac^orB o? coe? »5 incompatible hardware 
^SSir^osi"" ef?SS"ed »ith different hardware 
configurations . 

test aoore -^at-^^i^ ^^.^^^^''^rwi^^^^^^^ K?" 
'^TltTo^t ^rJlf^^SurStSfereSce between two out.tandln. 
programs was the test score data. 

Recommendat ions 

1. Discontinue the Ideal system at Cessna. 

2. Continue the present CCC J^^!?^:, ^'^^iL^pa^^^ 
Street and Adams for one more year allowing principals 
utilize the programs in different ways. 

3 Plan to purchase CCC as the district J^^/" 
Itudy'^Se'^ost information of various configuration^ 

r-^rifnone^^^^^^^^^ _ 

To-rtt^r:^^^^^^^^^^^ --^^ 

however, delay implementation for two years. 

4 Plan for expansion of XLS to other schools with large 
numbers of at-risk children. 

5. Investigate the poselbllity of "^iJ^^J^infoLeLn? 

extension of Chapter ^ i»?*™°*^°S;il ae plr? of Chapter 1. 
aspect "of the eysten should work weix as pan- 

6. incorporate into -Pf f P^fJ^f.^^^ifit^y'^''^ 
teachers and screening of lab aides remain 

adaptability, ^^^^^fSf ?irseiting A ^aHttendan? is 

with their students in the lab setting. " 

a necessity for smooth operation of the system. 
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STANDARD DEVIATIONS 





CCC 

WAttRV 'FRANKLIN 


IDEAL 

Q^NA •FUNSIftfil 


Kdg WA 
V 
M 


5.33 
2.42 
3.54 


7.26 
3.38 
4,53 


5.93 
3.49 
4.53 


7.06 
4.04 


Grade 1 Wa 
V 
R 
M 


7.16 
5.42 
10.54 
4.81 


6.78 
5.78 
9.98 
3.92 


6.57 
4.71 
9.61 
3.73 


7.32 
6.19 

4.77 


Grade 2 V 
R 
M 


5.23 
10.96 
5.28 


5.39 
11,77 
5.26 


5.69 
10.18 
5.26 


6.02 
11.86 
5.22 


Grades V 
R 
L 
M 


4.61 
9.19 
5.56 
6.46 


5.90 
9.78 
5.87 
5.05 


6.09 
10.00 
7.46 
7.31 


4.60 
9.26 
6.42 
6.83 


Grade 4 V 
R 
L 
M 


5.88 
8.78 
6.80 
5.08 


5.76 
8.31 
6.71 
6.78 


6.23 
10.21 
6.88 
6.96 


5.75 
8.72 
6.16 
5.93 



JOST&4S 



4.66 
3.04 
3.24 

7.97 
6.74 
10.17 
6.03 

6.52 
11.64 
5.45 

5.55 
9.18 
6.62 
6.88 

7.69 
9.75 
7.35 
7.70 
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4.09 
4.90 

7.19 
6.77 
11.71 
5.77 

6.51 
12.34 
4.30 
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Lo Language Usage 
M« Math Computation 
V- Vocabulary 
R« Readbig 
WA« Word Analysis 
• m Control 
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Offkt of Dinctor 



Mo^c/i T4, 7 990 




WICHITA 

PUBLIC SCHOOLS 



{316) 833-4195 



Trogram Xvahation 



Enolo^exL you uUZt ^nd a -du^uey -xegaoct-ijas -the -wKegaated -Caa^uvcng 
-di/-*^em fILSi wAUch wa4 you-i c/v<X<i'^ ^choo^ t/eo^. The 

comput&A. tab u/a-6 ptacexL <n yoiui ^choct on a Za^^LoX bou*^ t.o cLeXe^irrUne. 

P-Ceo^e take, a iejuj irUnute^ youA. tMne. to ^.e^pond. A dec-t^on u/-o£-£. 
be. made, ^oon ■xegavLing the contAJ^uatlon oi the. computer. Zab and 
i^/h^the^ to expand the ^y^htejn to oth&A, ^ohoo^, Vowt. -Input aji thL4> 
de,CA^^on -c-* ^poA,tant. 

Any add^UU-onaZ convnent^ you would tJJie. to mahe, -xegcuacUn© the. ILS 
computer, tab w^Jtt at^o be app-^e^cMited . 

SAJtoe^ety , 



CofLotyn S . May , 'D-LA.ecXOA. 
pA.osA.ant E\/atuatLon 



DIRECTIONS 
r. U^e a P2 ^oit tead pen<UJL. 

2, C-Oiote ^ohoot, s^ade teveZ, and ^aex ioA. youngest oh^Mi. 

(Top o-it ioAm) 

3, F-ctt A,n t/e^ oa. no an-6we^-cng ioA youA. younse^ ch^Xd -In the. 
cahoot. 

4. WA.tte any add-ctlcnat comments on the. bachi thU^ teXte^. 

5. RetuA.n -i^uw/ey and cormient^ any} -in pA.e^tamped envelope 
ujh-Lch -t-A p-AOu-ided. 

RETURN BV APRIL 4 , 

een — 

ERfc ministrative Center 217 North Water Wichita, Kansas o7202 



CIRCLE THE CORRECT SCHOOL, GRADE, AND SEX: 

ADAMS CESSNA HARRY STREET 
My youngest child in this school is in grade; 
Sex: Female Male 



K 1 2 3 4 5 



YES 




1. 


H3S your cniKI dmh onroiwo ai mts scnooi an ymmi r 


' 1 ' 


.'2 ' 
V* * 


' 5 ■ 


. 4 : 




2. 


Have you visited the Integratad Learning System (iLo; compuier lao mis yearr 








■'a 




3. 


Do you feel the ILS computer tab has hetped your cniw mw year tn main r 




2 ' 


» 3 


4 




4. 


Do you feel the ILS computer tab has helped your cnoo mia year m reaoing r 


h 




3 




■ 
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5. 


Has your child indicated that he/she oKed goir^ lo me ilo oompuiwr lao r 


^ 1 , 


z 






9 ' 


6. 


Would you like to see the ILS computer lao ooniinueo ai your scnooir 




3 


3 
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7. 


Do you t>elieve the school system snouw put an iLd oDmpuier wo m mor« ^cnwia . 
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^» 
2 


3 


4 • 


<^ 
m 

9 f 


8. 


Addrtional comments may t>e written on an aoofiionai snaeL 


1 


, 2 , 


3 


• 4 








% '. 

I , 




-1 
i# 


. 4 
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5 ' 
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3 


4 . 






RETURN BY APRIL 4 
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1913. tSSS. Maimai Conifiut^ Svftwmt. Inc. Alt n^tm r*Mrv*<l. 



SURVEY 

Integrated Learning Syetem 
March. 1990 

TO: Staff, ILS Schools 
From: Carolyn May 

Ple..e fill out thie survey »^«8»"ii"*,^"!««"!!^t^?o™h^ 
6VB tens (ILS). Your input is extrenely lBPort«nt to the 
l^lSStlon of ILS. Thank you. 




^ ^ , Grade level: 

School : . — 



ERIC 



Respond YES or NO 

1. DO you believe the ILS was effective for moat of 

your pupils? 

2. Do you believe the ILS wae »ore effective for some 

ability groups than others? 
IF YBS. rank in order of effectiveness (1 being most 
effective). 

a. higher ability 

b- average ability 

c. lower ability 

3 Do you believe the ILS was equally effective in 

reading, math, and language arta? 

IF NO. rank in order of effectiveness. (1 being most 

effective) . 

a. redding 
b. language arts 

c . math 

J. +Vift TLS lab cor inued in your 
4. Do you want to see the J-*" 

school? 
IF HO, why not? 



OVER 

34 



5. Did you use the ILS mostly for: (rank order. 1 bein« 
DOBt effective) 

a. inetructional 

b. reinforcenent 

^ c. remedial 

6. Did you receive adequate support from: 

a. your principal 

b. district administration 

c. the vendor 

IF HO, please state what could have been improved? 



Please use the remaining space to write any comments you 
have regarding ILS in general and your system in particular. 



Return to Carolyn May, ADM CTR 
by April 6 



